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Abstract. - When a system is perturbed by the variation of external parameters, a lag generally 
develops between the actual state of the system, pt, and the equilibrium state corresponding to 
the current parameter values, p'^'^. We establish a microscopic, quantitative relation between this 
lag and the dissipated work that accompanies the process. We illustrate this relation using a model 
system. 



Introduction. — Irreversible thermodynamic pro- 
, cesses are those that cannot be undone: the system of 

■ interest and its surroundings never return to their original 
, states. There are a number of attributes that we typically 

■ associate with such processes. These include (i) dissipa- 
, tion - the dispersal of energy among many degrees of free- 
' dom; (ii) time-reversal asymmetry - the evident direction- 
, ality of time's arrow; and (iii) broken equilibrium - either 

within the system of interest, or between it and its thermal 
surroundings. For macroscopic systems these manifesta- 
tions of irreversibility are related through the strict logic 
J of the second law of thermodynamics. 

For microscopic systems the second law must be in- 

■ terpreted statistically, making allowances for fluctuations 
. around the mean behavior. Far from being uninterest- 
' ing, uninformative "noise" , such fluctuations have in re- 
, cent years been found to satisfy a number of exact and 

■ unexpected relations. [1] These in turn have sharpened 
our understanding of the second law as it applies at the 
microscopic scale. (See Section 7 of Ref. [2] for a brief 
summary.) Of specific relevance for the present paper is 
the discovery of quantitative relations between dissipation 
and time-reversal asymmetry, two of the above-mentioned 
manifestations of irreversibility. While several such rela- 
tions have appeared in the literature [3-7], we will focus 
on the formulation obtained by Kawai, Parrondo, and Van 
den Broeck [7], given by Eq. 1 below. 

Consider a process in which a system, initially at tem- 
perature , is driven away from equilibrium by varying 
an external parameter A from Aio B, over a time interval 



< t < T. By the second law, the average work performed 
on the system is no less than the free energy difference 
AF = Fb - Fa- The excess W^ss = {W) - AF > is 
eventually dissipated into the surroundings, and provides 
a physical measure of the dissipation that occurs during 
the process. Now consider also the time-reversed process, 
in which the parameter is switched in the reverse manner 
from B to A, and let pt = p(z, t) and pt = p{z, t) denote 
the phase space densities describing the evolution of the 
system during the two processes. Since pt and Pr-t rep- 
resent statistical "snapshots" that correspond to the same 
value of the parameter A [7], the relative entropy [8] be- 
tween these two distributions, I?[pt||pT-_f], quantifies the 
extent to which the state of the system during the for- 
ward process {A — *■ B) is distinguishable from that during 
the reverse process {B A). In other words, D[pt\\pT-t] 
provides an information-theoretic measure of time-reversal 
asymmetry. By showing that 

Wdiss > P^^ D[pt\\pr^tl (1) 

Kawai et al [7] have established a remarkably general in- 
equality between these microscopic measures of (i) dissi- 
pation and (ii) time-reversal asymmetry. The central goal 
of the present paper is to obtain a similarly general rela- 
tion between dissipation and (iii) the loss of equilibrium 
during an irreversible process. 

Restricting our attention to the forward process, let 
p1^ = p°'^{z, Xt) denote the equilibrium density corre- 
sponding to the value of the external parameter at time t. 
Although the system begins in equilibrium (po — Pq^): at 
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Fig. 1: As the external parameter is switched from A to B, a, 
lag develops as the system pursues the equilibrium distribution 
corresponding to the changing external parameter. 



later times pt pl^- This is illustrated schematically in 
Fig. 1: as A is varied with time, the system tries to keep 
pace with - but ultimately lags behind - the continually 
changing equilibrium distribution [9]. As in the previous 
paragraph, we can use relative entropy to quantify this 
lag: £'[/3t||/9j'^] measures the extent to which the system 
is out of equilibrium at time t. The central result of this 
paper is the inequality 



W^diss(i)>/3"'^[ptl|pr 



(2) 



where Tl^diss [t) is the amount of work dissipated up to time 
t during the process. Thus the dissipated work dictates 
the maximum extent to which equilibrium can he broken 
- cquivalcntly, the maximum amount of lag - at a given 
instant during the process. 

Our result Eq. 2 is valid for < t < r. However, unlike 
Eq. 1 our central result does not explicitly depend on the 
duration (t) of the process. 

We now derive our central result for systems driven ar- 
bitrarily far from equilibrium. We will then illustrate this 
result with an exactly solvable model system. 

Theory. — Consider a classical system described by a 
parameter-dependent Hamiltonian Hx (z) where z denotes 
a point in the phase space of the system. At fixed param- 
eter value A and temperature /?~^, the equilibrium state 
of the system is described by the probability distribution, 



p^i(z,A) 



(3) 



with free energy F\ = — /?~^ ln.^A- 

Imagine a process during which the system is initially 

brought to thermal equilibrium with a heat bath at tem- 
perature at fixed A = A, after which the external 



parameter is varied from A(0) = A to A(t) = B. We will 
assiimc that the evolution of the system during this pro- 
cess is governed by dynamics that are Markovian and bal- 
anced-^ that is, the equilibrium distribution (Eq. 3) is con- 
served when A is held fixed. The time-dependent density 
Pt = p{z, t) describes an ensemble of trajectories evolving 
under these dynamics. 

For such processes, p(z, t) satisfies [10-12] 



Za 



. p{z,t){e-P^(%, 



where 



W{t)= [ A 
Jo 



dX 



(4) 



(5) 



denotes the work performed on the system along a tra- 
jectory z{t), and (. . . )z.t denotes an average over all the 
trajectories that pass through z at t. Equation 4 can be 
rewritten using Eq 3 to obtain 



p{z,t) 



-0AF{t) 



(6) 



where AF(t) = Fx(t) — Fa- Taking the logarithm of both 
sides of this equation, then invoking Jensen's inequality [8] 



we get 



{W{t)). 



^'-"^ P^'»(z,A(t)) 



(7) 



(8) 



Finally, multiplying both sides of Eq 8 by pt and integrat- 
ing with respect to z, we obtain 



{w{t)) - AFit) > r 



dz Pt In-gg-. 
Pt 



(9) 



Since the left side of this equation represents the work dis- 
sipated to time t, and the right side is the relative entropy 
of Pt with respect to pt^, we have arrived at our central 
resuh (Eq. 2). 

We now comment on a few aspects of this result. 

First, Stein's lemma [8] relates the relative entropy 
D[/||(7] to the difficulty of statistically distinguishing be- 
tween two distributions / and g. Thus, Eq 9 directly con- 
nects the work dissipated up to a given time, W^issit), 
to a microscopic measure of the current deviation of the 
system from equilibrium, £)[pt||/9('^]. It is worthwhile to 
discuss this deviation in some detail, for two separate sit- 
uations. 

(a) If the system remains in contact with a heat bath 
as A is switched from A to B, then as suggested by Fig. 1 
we can picture the deviation of pt from pl'^ as a lag that 
develops because the system cannot keep pace with the 
changing equilibrium state. [9,13,14] Eq. 9 tells us that the 
dissipated work places an upper bound on this lag. In the 
special case that the parameter is varied quasistatically. 
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and the heat bath is much larger than the system, then 
on general grounds we expect the system to remain in 
equilibrium, pt — pl'^; in this case there is no dissipation, 
since W{t) = ^F{t) for a reversible, isothermal process, 
and both sides of Eq. 9 are equal to zero. 

(b) If we instead imagine that, after using a heat bath 
to prepare the system in an initial state of equilibrium, the 
heat bath is disconnected prior to the actual switching pro- 
cess, then during the interval < i < r the now-isolated 
system evolves under Hamilton's equations. As a result, 
a unique trajectory passes through any point z at time i, 
hence Eq. 7 becomes an equality and so does our central 
result ' 

w^^.(t) ^ p-' D[p,\\p1\ (10) 

Since the system is not continually attempting to equili- 
brate with an external heat bath, it is not immediately 
natural to view the deviation of pt from pl'^ in terms of 
lag. (Indeed, even if A is varied quasistatically, the dis- 
tribution Pt will deviate from the isothermal, canonical 
distribution pl"^ [10,15,16].) However, we can place this 
scenario within the "lag framework" by considering an iso- 
lated system to be a particular, limiting case of a system 
in contact with an external heat bath, in which the degree 
of thermal contact is so weak that the effects of the bath 
are negligible over a time interval of duration r. If the 
external parameter is held fixed at A = i? for t > r, then 
after a very long time the system does relax to a state of 
thermal equilibrium described by p^'^{'L, B). In this paper 
we will adopt this perspective, and will view the relative 
entropy I?[pt||p(''] as a quantitative measure of lag, even 
in the case of a thermally isolated system. 

We finally note that when t — t, Eqs. 1 and 2 are equiv- 
alent, since p{z, 0) = p°^(z, B). In other words, the initial 
state of the system during the reverse process is precisely 
the equilibrium state corresponding to the final value of A 
during the forward process. 

Examples. — Recent analyses of exactly solvable 
models [17,18] have provided insight into Eq. 1. We now 
illustrate our central result, Eq. 2, using a model that in- 
volves the quasistatic expansion or compression of a dilute 
gas of particles in d spatial dimensions. The model, shown 
in Fig. 2, is motivated by Refs. [16,19]. The gas is a two- 
component mixture, in which component 1 is confined by 
the piston (open circles in Fig. 2), while the particles of 
component 2 pass freely through the piston (filled circles). 
Let A denote the position of the piston, V\ the volume of 
space to the left of the piston, V the total volume of the 
container, and A^i and N2 the numbers of particles in each 
component. For simplicity, we assume all particles have 
the same mass, m. 

This mixture is initially allowed to come to thermal 
equilibrium with an external heat bath at temperature 
f3~^, with the piston held fixed at A = ^; then thermal 
contact between the gas and the external bath is broken; 
and finally, from i = to t = t, component 1 undergoes 
compression or expansion as the piston is manipulated 
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Fig. 2: A two-component dilute gas, where component 1 (open 
circles) is confined by the piston, while component 2 (filled 
circles) is not. 



quasistatically according to a protocol X{t). During the 
latter stage the mixture evolves under Hamilton's equa- 
tions in 2d{Ni + Af2)-dimensional phase space. 

This particular model is convenient because it can be 
used to illustrate both scenarios (a) and (b) discussed in 
the previous section. If we define our system of interest 
to be the entire two-component mixture, then this model 
illustrates a system that is thermally isolated during the 
switching process, as per scenario (b). Alternatively, if we 
take our system of interest to be component 1, and view 
component 2 as part of a heat bath, then the model illus- 
trates scenario (a). We will analyze these two cases below. 
We will solve explicitly for dissipated work and relative en- 
tropy in each case, and will show that our central result 
is an equality in the case of a thermally isolated system 
of interest (Eq. 10), and an inequality when the system 
remains in contact with a heat bath (Eq. 2). 

Hamiltonian Dynamics. Let z = {zi,Z2} denote a 
point in the full, 2d{Ni + iV2)-dimensional phase space, 
with zi and Z2 denoting the phase coordinates of com- 
ponents 1 and 2, respectively. The Hamiltonian for this 
system is H\{z). As in Ref. [16], we take the term "dilute 
gas" to imply that, while particles do exchange energy via 
pairwise collisions, the mean free path between collisions 
is much greater than the characteristic distance between 
nearby particles. For practical purposes, we take this to 
mean that the particle-particle interaction terms in H\(z) 
can be neglected in the calculations that follow. Thus Hx 
is taken to be a sum of kinetic energies, and hard- wall 
potentials that confine the two components to volumes V\ 
and V. We also assume that when the piston is held fixed, 
the Hamiltonian dynamics are ergodic, i.e. the mixture is 
able to self-equilibrate via particle-particle collisions. Fi- 
nally, the term "quasistatic" is meant to imply that the 
compression or expansion proceeds sufficiently slowly for 
continual self-equilibration to occur. 

For fixed A and positive energy value E, let 4>x{E) de- 
note the volume of phase space enclosed by the energy 
shell (i.e. surface of constant energy) H\{z) = E; and let 
us think of g\{E) = d(j)/dE as the "surface area" of this 
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shell. By explicit calculation, we have 



ME) 
9x{E) 



I dz5{E - H^) = /If ^y^^ll^ (12) 



where 



N2) 



27rm 



(13) 



and r(A;) is the gamma function. At temperature (3 ^ , the 
partition function and free energy of the mixture are: 

Z^iP) = J dEg^ e-^"" = ti'^V^-V^'^li-'^ (14a) 

f'AC/?) = In • (14b) 

When the piston is moved quasistatically from A(0) = A 
to A(t) = B, the value of (j)\{Hx) is an adiabatic invari- 
ant [16]. By Eq. 11, this implies 



T/-/V1 pfc 



yNi pk 



(15) 



along a trajectory z(t) with energy Et = Hx(t){^{t))- The 
work performed on the mixture is given by net change in 
its energy. 



W{t) =Et-Eo 



Ni/k 



Eo = a{t)Eo. (16) 



Since W{t) is determined uniquely by the initial energy, 
Eq, and initial conditions arc' sampled from the equilib- 
rium distribution at temperature /?~^, we have: 



{W{t)) 



dEogA{Eo)e-^^"a{t)Eo 



1 

Jo 

= a{t) {Eo) = k(3-'^a{t) 
Finally, from Eq. 14 we get 

Va 



AF{t) = iVi/3-1 In 



kp-Hn [a{t) + 1] 



(17) 



(18) 



Prom the first expression on the right is is clear that this 
quantity depends on A''i but not on N2; effectively, AF{t) 
specifies a free energy difference between two equilibrium 
states of component 1, as the equilibrium state of compo- 
nent 2 is unaffected by the piston. 

Combining Eqs. 17 and 18 yields the following compact 
expression for the dissipated work: 



Wdiss{t) = kf3-^[a-ln{a + l)] 



(19) 



To compute D[pt||pj''], we consider a trajectory zj = 

z(t) evolving imdcr Hamilton's equations. By Liouville's 
theorem, the value of phase space density is conserved 
along this trajectory, hence 



p{Zt,t) = /9(zo,0) 



ZaW) 



-l3Eo 



Za{I3) 



(20) 



where (3t = (}/[a{t) + 1], and we have made use of Eq. 16. 
With Eq. 14a we can confirm that Za{P) = ■^A(t) (A), thus 



p{z,t) = 



-/3tH^(t)(z) 



(21) 



In other words, during the compression or expansion pro- 
cess the phase space density is a canonical distribution 
with a slowly time-dependent temperature, /3j~^. By con- 
trast, p^^i is defined at a constant temperature, 



p'^^{z,X{t)) = 



Zxit){l3) 



(22) 



We therefore have 

In = (/3 - A) ifA(t) (z) -kin (/3/A) . (23) 
Pt 

Multiplying both sides by Eq. 21 and integrating, we get 
DlPtWpT] = (/? - Pt) kp-' - fcln(a + 1) 



k[a- ln(a + 1) 



(24) 



Comparing with Eq. 19, we see that Eq. 10 is satisfied. 

Stochastic dynamics. Now let us view component 1 
of our mixture as the system of interest, and component 
2 as part of the heat bath. ^ The phase space of the 
system of interest is now 2(iA'"i-dimensional, and evolution 
in this space is stochastic rather than deterministic, as the 
variables Z2 have been projected out. We will use a carat 
(') to denote reduced phase space densities describing the 
system of interest (component 1): 



Pt = p{^i,t) = j dz2p{z,t) 



Pt 



r{^uX{t))= I dZ2P^\z,\{t)) . 



(25) 



The relative entropy [/5(| |/5°''] quantifies the degree to 
which the system of interest is out of equilibrium (as be- 
fore, "equilibrium" is defined by the temperature /3~^ and 
the ciirrent value of A) and we wish to compare this with 
the dissipated work, Wdiss(i) = {W{t)) - AF{t). 

(Before proceeding further, we note that the stochastic 
evolution of the system of interest is non-Markovian, thus 
it is not immediately obvious that the analysis of the pre- 
vious section (Theory) can be applied to this situation; 
see the assumptions stated after Eq. 3. To address these 
concerns, we verify in the Appendix that Eq. 6 remains 
valid for the reduced densities, even though the evolution 
is non-Markovian.) 

Since the particles of component 2 pass freely through 
the piston, the values of {W{t)) and AF{t) are the same 
as before (s(-e comment following Eq. 18). By contrast. 



-"^Thus the entire heat bath is composed of both the external bath 
used to prepare the initial state of equilibrium, and the particles of 
component 2, which remain in contact with the system of interest 
during the process. 
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since the reduced densities are obtained by projecting from 
the full phase space to that of component 1, there will 
be a reduction in the value of the relative entropy [8]: 
D [pt\\Pt^] < D [ptWpl'^], as we now confirm by direct eval- 
uation. 

Because pt and p°'^ are canonical distributions in the full 
phase space (Eqs. 21, 22), the reduced densities are also 
canonical: 



100 



1 



Pt 



---eq 

Pt = 



Zxit){Pt) 



-A(t) 



(/?) 



where H^^^ is the Hamiltonian for component 1, and 



We now have 



ki = dNi/2. 



Pt 



In ^ = (/3 - Pt) i?l|;)(zi) - fci In (p/Pt) . 

Multiplying by Eq. 26 and integrating, we obtain 

DiptWp't''] = {P- Pt) kiPt^ - fci ln(a + 1) 
= ki[a — \n{a + 1)] 

^^pW^Ut)^^D[pt\\p1\ 



(26) 
(27) 

(28) 
(29) 



(30) 



where iV = A^i + A^2 is the total number of particles in the 
mixture. ^ As expected, our central result (Eq. 2) now 
holds as a strict inequality. 

Finally, let us consider what happens when component 
2 is much larger than component 1; formally, N2 — > 00 
with Ni fixed. By straightforward evaluation wc find 



~pt=P+0{l/N) 
D[ptW]^l/N\ 



(31) 



Physically, this limit describes the reversible and isother- 
mal compression or expansion of component 1, with com- 
ponent 2 playing the role of an infinite heat bath. We see 
that both W^issit) and D[pt\\pt'^] approach zero, but at 
different rates, as illustrated in Fig. 3. 



Summary. — When a system is driven away from 
equilibrium by the variation of external parameters, the 
relative entropy Z?[ptl|Pt'^] quantifies the degree to which 
the current state of the system, p{z,t), lags behind the 
instantaneous equilibrium state, p°'^(z, X{t)). Our central 
result, Eq. 9, shows that the dissipated work, Wdiss{t), 
provides an upper bound on the value of this lag. In the 
special case that the dynamics of the system are Hamilto- 
nian, the dissipation fully specifies the lag (Eq 10). These 



■^Eq. 30 is easy to understand: £'[pt||P(''] is a sum of equal con- 
tributions from each of the N particles in the mixture, but only A^i 
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Fig. 3: Dissipation (/3Wdiss(i)) and lag (£'[pt||pt'']) are plotted 
as functions of N2, with Ni = 10, d = 3, Vo/Vx(t) = 5, and 
l3 = 1. The isothermal limit is achieved as 7V2 ^ 00. 



results complement analogous results obtained for the rela- 
tionship between dissipated work and time-reversal asym- 
metry [7], as measured by D[pt\\pT-t]- 
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Appendix. — In the full phase space, Eq. 4 can be 
rewritten as 

p°'i(z, A(i))e-^^^W = p{z, t)e-^'^^'\ (32) 

where W{t) is the work performed along the unique tra- 
jectory that passes through z at time t. Integrating both 
sides with respect to Z2, we get 

p<=<^(zi,A(t))e-''^^(*) =p(zi,t)(e-W*)\ . (33) 

Rearranging terms we see that the reduced densities sat- 
isfy Eq. 4. 
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